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CLAIMS 

What is claimed is: 




1 ^ A method comprising: 

2 accessing a first multi-dimensional graphical representation that describes the 

3 appearance of a plurality of points of an object from a plurality of 

4 viewing directions, the appearance varying from point to point and 

5 viewing direction to viewing direction; 

6 creating a second graphical representation that approximates the first graphical 

7 representation and that includes at least one expression having a fewer 

8 dimensions than the first multi-dimensional graphical representation by 

9 decomposing the first multi-dimensional graphical representation into 
10 the second graphical representation, the decomposing including 

-Q 1 1 selectively representing information from the first graphical 

^ 12 representation. 

1 2. The method of claim 1 , further comprising expressing the first graphical 

2 representation as a matrix, and wherein creating the second graphical 

3 representation includes using singular value decomposition to decompose the 

4 first multi-dimensional graphical representation into a first vector multiplying a 

5 second vector. 

1 3. The method of claim 1, wherein creating by decomposing includes selectively 

2 representing information from the first graphical representation that is most 

3 important to describe the appearance of the object and neglecting redundant 

4 information from the first graphical representation that is less important to 

5 describe the appearance of the object. 
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1 4. The method of claim 1, further comprising: 

2 accessing a third muhi-dimensional graphical representation that describes the 

3 appearance of a second plurality of points of the object from a plurality 

4 of viewing directions, the second plurality of points including the first 

5 plurality of points, and the appearance varying from point to point and 

6 viewing direction to viewing direction; and 

7 partitioning the third multi-dimensional graphical representation into a 

8 plurality of smaller multi-dimensional graphical representations each 

9 associated with a primitive of a polygonal representation of the 

10 geometry of the object, the plurality of smaller multi-dimensional 

1 1 graphical representations including the first multi-dimensional 

1 2 graphical representation. 

1 /(^ A method comprising: 

2 accessing a first graphical representation that describes the appearance of a 

3 plurality of points on an object; 

4 creating a second graphical representation based on the first graphical 

5 representation, the second graphical representation containing less 

6 redundant descriptive information than the first graphical 

7 representation, and the second graphical representation containing a 

8 plurality of portions that are capable of being concurrently combined to 

9 display the plurality of points of the object with an appearance 
1 0 associated with a particular viewing direction. 

1 6. The method of claim 5, wherein the first graphical representation describes the 

2 appearance of a plurality of points of an object from a plurality of viewing 
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directions, the appearance varying from point to point and viewing direction to 
viewing direction. 

7. The method of claim 5, wherein creating includes creating a second graphical 
representation that includes a plurality of portions capable of being expressed 
as matrices, the method further comprising expressing the plurality of portions 
as matrices. 

8. The method of claim 5, further comprising: 
storing the second graphical representation; 

receiving a request on a network for the second graphical representation; 
transmitting the second graphical representation on the network after receiving 
the request. 

9. The method of claim 5, wherein creating includes creating a second graphical 
representation that includes a plurality of portions that can be combined using 
multitexturing hardware that allows multiple textures to be concurrently 
applied to a primitive in a single rendering pass. 

10. The method of claim 5, wherein creating includes creating a second graphical 
representation that includes a plurality of portions that are capable of being 
concurrently combined without decompressing the plurality of portions. 

1 1 . The method of claim 5, further comprising: 

accessing a third graphical representation that describes the appearance of a 
second pluraUty of points of the object from a plurality of viewing 
directions, the second plurality of points including the first plurality of 
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points, and the appearance varying from point to point and viewing 
direction to viev^ing direction; and 
partitioning the third graphical representation into a pluraUty of smaller 

graphical representations each associated w^ith at least one primitive of 
a polygonal representation of the geometry of the object, the plurality 
of smaller multi-dimensional graphical representations including the 
first multi-dimensional graphical representation. 



yi, A machine-readable medium having stored thereon data representing 

sequences of instructions that when executed cause a machine to perform 
operations comprising: 

accessing a first graphical representation that describes the appearance of a 
plurality of points on an object; 

creating a second graphical representation based on the first graphical 

representation, the second graphical representation containing less 
redundant descriptive information than the first graphical 
representation, and the second graphical representation containing a 
plurality of portions that are capable of being concurrently combined to 
display the plurality of points of the object with an appearance 
associated with a particular viewing direction. 

13. The machine-readable medium of claim 12, wherein the instructions for 
accessing the first graphical representation fiirther comprise instructions 
causing the machine to perform operations comprising accessing a first 
graphical representation that describes the appearance of a plurality of points 
of an object from a plurality of viewing directions, the appearance varying 

from point to point and viewing direction to viewing direction. 
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1 14. The machine-readable medium of claim 12, wherein the instructions for 

2 creating further comprise instructions causing the machine to perform 

3 operations comprising creating a second graphical representation that includes 

4 a plurality of portions capable of being expressed as matrices. 

1 15. The machine-readable medium of claim 12, wherein the instructions for 

2 creating further comprise instructions causing the machine to perform 

3 operations comprising creating a second graphical representation that includes 

4 a plurality of portions that can be combined using multitexturing hardware that 

5 allows multiple textures to be concurrently applied to a primitive in a single 
^ 6 rendering pass. 

1 16. The machine-readable medium of claim 12, wherein the instructions for 

^0 2 creating further comprise instructions causing the machine to perform 

3 operations comprising creating a second graphical representation that includes 

4 a plurality of portions that are capable of being concurrently combined without 

5 decompressing the plurality of portions. 



1 17. The machine readable medium of claim 12, wherein the instructions further 

2 comprise instructions causing the machine to perform operations comprising: 

3 accessing a third graphical representation that describes the appearance of a 

4 second plurality of points of the object from a plurality of viewing 

5 directions, the second plurality of points including the first plurality of 

6 points, and the appearance varying from point to point and viewing 

7 direction to viewing direction; and 

8 partitioning the third graphical representation into a plurality of smaller 

9 graphical representations each associated with at least one primitive of 
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a polygonal representation of the geometry of the object, the plurality 



of smaller multi-dimensional graphical representations including the 



first multi-dimensional graphical representation. 



A method comprising: 



accessing image-based data for an object that describes the appearance of the 

object from a plurality of viewing directions; 
dividing the image-based data into a plurality of smaller portions associated 

with regions on the object; 
standardizing each of the pluraUty of smaller portions; 
creating a plurality of approximate graphical representations that approximate 

the plurality of standardized portions by selectively representing certain 

non-redimdant information from each of the plurality of standardized 

portions; and 

storing each of the plurality of approximate graphical representations. 

19. The method of claim 1 8 : 

wherein dividing the image-based data includes partitioning the image-based 
data into a plurality of subsets of image-based data, each subset of 
image-based data describing the appearance of a primitive-defined 
region of the object for a particular viewing direction, each subset 
having a higher degree of spatial coherency than the set of image-based 
data; 

wherein standardizing includes normalizing the size of each of the plurality of 
subsets of image-based data to a predetermined size, normalizing the 
shape of each of the plurality of subsets of image-based data to a 

predetermined shape, and using the plurality of subsets of image-based 
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data to compute a resampled plurality of subsets of image-based data 
that correspond to predetermined standardized viewing directions; and 
wherein creating a plurality of approximate graphical representations includes 
creating for each primitive-defined region a first data structure that is 
independent of the viewing direction and a second data structure that 
includes a plurality of portions that each correspond to a different 
viewing direction. 

20. The method of claim 1 8, further comprising: 

acquiring geometry data for an object that describes the geometric extents of 

the surface of the object; 
converting the geometry data into a geometric representation of the geometry 

of the object; and 

acquiring image-based data that describes the appearance of the surface of the 
object from a plurality of viewing directions. 

2 1 . The method of claim 1 8, further comprising: 

receiving a request for graphical content associated with the object from 

another computer system; 
transmitting a plurality of approximate graphical representations to the other 

computer system; and 
transmitting geometry data for the object to the other computer system. 



A data structure comprising at least a first portion and a second portion, the 
second portion including a second plurality of view-dependent subportions 
including a first view-dependent subportion that corresponds to a first viewing 
direction and a second view-dependent subportion that corresponds to a second 
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viewing direction, wherein the first portion and the first view-dependent 
subportion are combinable using multitexturing hardware that allows multiple 
textures to be concurrently applied to a primitive in a single rendering pass to 
display a plurality of points of an object with a first appearance corresponding 
to a first viewing direction, and wherein the first portion and the second view- 
dependent subportion are combinable using the multitexturing hardware to 
display the plurality of points of the object with a second appearance 
corresponding to a second viewing direction. 

23. The data structure of claim 22, wherein the data structure is derived from a 
plurality of images acquired for the object by selectively representing 
information fi-om the plurality of images that is important to describe the 
appearance of the object and selectively removing information fi-om the 
plurality of images that is redundant. 

24. The data structure of claim 22, wherein the first portion and the first view- 
dependent subportion are combinable without decompression using the 
multitexturing hardware. 

25. The data structure of claim 22, wherein the first portion and the second portion 
are created by decompressing a corresponding compressed first portion and a 
corresponding compressed second portion of another data structure. 



:o. A data structure comprising a plurality of portions that are combinable without 
interpolation to display a plurality of points of the object with a first 
appearance for a first viewing direction and display the plurality of points with 
a second appearance for a second viewing direction. 
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1 27. The data structure of claim 26, the data structure being derived from a pluraUty 

2 of images acquired for an object by representing important information that 

3 describes the appearance of the object and removing redundant information 

4 associated with the plurality of images. 

1 28. The data structure of claim 26, wherein the plurality of portions are 

2 combinable without decompression. 

1 29. The data structure of claim 26, wherein the plurality of portions are created by 

2 decompressing corresponding compressed portions of another data structure. 

1 30. The data structure of claim 26, wherein the plurality of portions include a first 

2 matrix and a second matrix that are concurrently combinable using 

3 multitexturing hardware that allows multiple textures to be concurrently 

4 applied to a primitive in a single rendering pass. 
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